Automatic Detection of Lung Ultrasound Artifacts using a Deep Neural Networks approach

The COVID-19 pandemic has challenged many of the healthcare systems around the world. Many patients who have been hospitalized due to this disease develop lung damage. In low and middle-income countries, people living in rural and remote areas have very limited access to adequate health care. Ultrasound is a safe, portable and accessible alternative;however, it has limitations such as being operator-dependent and requiring a trained professional. The use of lung ultrasound volume sweep imaging is a potential solution for this lack of physicians. In order to support this protocol, image processing together with machine learning is a potential methodology for an automatic lung damage screening system. In this paper we present an automatic detection of lung ultrasound artifacts using a Deep Neural Network, identifying clinical relevant artifacts such as pleural and A-lines contained in the ultrasound examination taken as part of the clinical screening in patients with suspected lung damage. The model achieved encouraging preliminary results such as sensitivity of 94%, specificity of 81%, and accuracy of 89% to identify the presence of A-lines. Finally, the present study could result in an alternative solution for an operator-independent lung damage screening in rural areas, leading to the integration of AI-based technology as a complementary tool for healthcare professionals. © 2023 SPIE.

Video-Based Online Interactive System Using CNN Segmentation Method

In recent years, the COVID-19 has made it difficult for people to interact with each other face-to-face, but various kinds of social interactions are still needed. Therefore, we have developed an online interactive system based on the image processing method, that allows people in different places to merge the human region of two images onto the same image in real-time. The system can be used in a variety of situations to extend its interactive applications. The system is mainly based on the task of Human Segmentation in the CNN (convolution Neural Network) method. Then the images from different locations are transmitted to the computing server through the Internet. In our design, the system ensures that the CNN method can run in real-time, allowing both side users can see the integrated image to reach 30 FPS when the network is running smoothly. © 2023 IEEE.

Integrating deep learning algorithms for the lung segmentation and body-part-specific anatomical classification with Medical Imaging and Data Resource Center (MIDRC)

Medical Imaging and Data Resource Center (MIDRC) has been built to support AI-based research in response to the COVID-19 pandemic. One of the main goals of MIDRC is to make data collected in the repository ready for AI analysis. Due to data heterogeneity, there is a need to standardize data and make data-mining easier. Our study aims to stratify imaging data according to underlying anatomy using open-source image processing tools. The experiments were performed using Google Colaboratory on computed tomography (CT) imaging data available from the MIDRC. We adopted the existing open-source tools to process CT series (N=389) to define the image sub-volumes according to body part classification, and additionally identified series slices containing specific anatomic landmarks. Cases with automatically identified chest regions (N=369) were then processed to automatically segment the lungs. In order to assess the accuracy of segmentation, we performed outlier analysis using 3D shape radiomics features extracted from the left and right lungs. Standardized DICOM objects were created to store the resulting segmentations, regions, landmarks and radiomics features. We demonstrated that the MIDRC chest CT collections can be enriched using open-source analysis tools and that data available in MIDRC can be further used to evaluate the robustness of publicly available tools. © 2023 SPIE.

Thermal Image Processing System for the measurement of body temperature using a Drone

In December 2019, several cases of pneumonia caused by SARS-CoV-2 were identified in the city of Wuhan (China), which was declared by the WHO as a pandemic in March 2020 because it caused enormous problems to public health due to its rapid transmission of contagion. Being an uncontrolled case, precautions were taken all over the world to moderate the coronavirus that undoubtedly was very deadly for any person, presenting several symptoms, among them we have fever as a common symptom. A biosecurity measure that is frequently used is the taking of temperature with an infrared thermometer, which is not well seen by some specialists due to the error they present, therefore, it would not represent a safe measurement. In view of this problem, in this article a thermal image processing system was made for the measurement of body temperature by means of a drone to obtain the value of body temperature accurately, being able to be implemented anywhere, where it is intended to make such measurement, helping to combat the spread of the virus that currently continues to affect many people. Through the development of the system, the tests were conducted with various people, obtaining a more accurate measurement of body temperature with an efficiency of 98.46% at 1.45 m between the drone and the person, in such a way that if it presents a body temperature higher than 38° C it could be infected with COVID-19. © 2023 IEEE.

Chest X-ray Imaging System for Early Detection of Tuberculosis

Today it is observed that few people respect the biosecurity measures announced by the WHO, which aimed to reduce the amount of COVID-19 infection among people, even knowing that this virus has not disappeared from our environment, being an unprecedented infection in the world. It should be noted that before this pandemic, tuberculosis affected millions of people, having a great role because it is highly contagious and directly affects the lungs, although it has a cure, if it is not treated in time it can be fatal for the person, although there are many methods of detection of tuberculosis, one that is most often used is the diagnosis by chest x-ray, although it has low specificity, when the image processing technique is applied, tuberculosis would be accurately detected. In view of this problem, in this article a chest X-ray image processing system was conducted for the early detection of tuberculosis, helping doctors to detect tuberculosis accurately and quickly by having a second opinion by the system in the analysis of the chest x-ray, prevents fatal infections in patients. Through the development of the tuberculosis early detection system, it was possible to observe the correct functioning of the system with an efficiency of 97.84% in the detection of tuberculosis, detailing the characteristics presented by normal or abnormal images so that the doctor detects tuberculosis in the patient early. © 2023 IEEE.

An Improved Computer Vision based Face Mask Detection and Alerting System

A global healthcare crisis has been declared as a result of the covid-19 nandemic's extensive snread. The coronavirus spreads mostly by the release of droplets from an infected person's irritated nose and throat. The risk of spreading disease is highest in public gathering places. Wearing a facial mask in public is one of the greatest ways, according to the World Health Organization, to avoid getting an infectious disease. This research work proposes an approach to human face mask detection using TensorFlow and OpenCV. Whether or not a character is wearing a mask is indicated by an enclosing field drawn around their head. An alert email will be sent to a person whose face is in the database if they make a call without a mask worn. © 2023 IEEE.

Doc-Handler: Document Scanner, Manipulator, and Translator based on Image and Natural language processing

Physical documents may easily be converted into digital versions in the modern digital era by employing scanning software and the internet. The day when this activity needed printers and scanners is long gone. Nowadays, even our smartphones and cameras may be used to quickly convert paper documents into digital ones. This is especially useful in the wake of the COVID-19 pandemic, where the ability to share and access documents online is more important than ever. This study proposes an application for illiterate people to quickly translate scanned papers or photos into their native language and save them in a digital format. The Application makes use of image processing methods and has capabilities including PDF conversion, image colour adjustment, cropping, and Optical Character Recognition (OCR). A user-friendly application, developed using the Flutter Framework and programmed in Python and Dart, serves as the interface for the system. The proposed application is cross-platform and works with a variety of gadgets. This method intends to increase accessibility and productivity for illiterate people in the digital age by integrating image processing with language translation. © 2023 IEEE.

A Shuffling Building Block and Augmentation Parameter Tuning Techniques to Handle Small Medical Dataset

The recent COVID-19 outbreak showed us the importance of faster disease diagnosis using medical image processing as it is considered the most reliable and accurate diagnostic tool. In a CNN architecture, performance improves with the increasing number of trainable parameters at the cost of processing time. We have proposed an innovative approach of combining efficient novel architectures like Inception, ResNet, and ResNet-Xt and created a new CNN architecture that benefits Extreme Cardinal dimensions. We have also created four variations of the same base architecture by varying the position of each building block and used X-Ray, Microscopic, MRI, and pathMNIST datasets to train our architecture. For learning curve optimization, we have applied learning rate changing techniques, tuned image augmentation parameters, and chose the best random states value. For a specific dataset, we reduced the validation loss from 0.22 to 0.18 by interchanging the architecture's building block position. Our results indicate that image augmentation parameters can help to decrease the validation loss. We have also shown rearrangement of the building blocks reduces the number of parameters, in our case, from 5,689,008 to 3,876,528. © 2023 IEEE.

Towards Understanding the COVID-19 Specific Patterns in Lung CT Scan Images using Deep CTNET Framework

Automated diagnosis of COVID-19 based on CTScan images of the lungs has caught maximum attention by many researchers in recent times. The rationale of this work is to exploit the texture patterns viz. deep learning networks so that it reduces the intra-class similarities among the patterns of COVID-19, Pneumonia and healthy class samples. The challenge of understanding the concurrence of the patterns of COVID-19 with other closely related patterns of other lung diseases is a new challenge. In this paper, a fine-tuned variational deep learning architecture named Deep CT-NET for COVID-19 diagnosis is proposed. Variation modelling to Deep CT-NET is evaluated using Resnet50, Xception, InceptionV3 and VGG19. Initially, grey level texture features are exploited to understand the correlation characteristics between these grey level patterns of COVID-19, Pneumonia and Healthy class samples. CT scan image dataset of 20,978 images was used for experimental analysis to assess the performance of Deep CT-NET viz., all mentioned models. Evaluation outcomes reveals that Resnet50, Xception, and InceptionV3 producing better performance with testing accuracy more than 96% in comparison with VGG19. © 2022 IEEE.

From Art Image to Video/Comic-Image Learning. The Video Spot Stay at Home

From the Covid-19 health emergency entered our lives, the web continues to alleviate moments of isolation with ironic memes, photos and videos that, despite having been considered an irreverence to the masterpieces of Art and/or one of the many uses of irony to exorcise fear, they have favored the staging of video-graphic products with a strong ‘humor' component. Within these premises, in the context of graphic design, this paper will evaluate aspects as the analysis of fashion environment as expressive language of living indoor during Covid-19 pandemic;the audiovisual languages and compositional criteria for the creation and multimedia communication of a video-graphic spot on Stay at home communication campaign. The video-graphic products were analyzed on the basis of: relationship between ‘humor' message and supporting artwork;integration between image and photo-cinematography;figurative languages generative of graphic signs;duration of audiovisual spot;sound component as key to emotional reading;communication strategies. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

A Review of the Application of Artificial Intelligence in Medicine: From Data to Personalised Models

Artificial intelligence leverages sophisticated computation and inference to generate insights, enables the system to reason and learn, and empowers decision making of clinicians. Starting from data (medical images, biomarkers, patients' data) and using powerful tools such as convolutional neural networks, classification, and regression models etc., it aims at creating personalized models, adapted to each patient, which can be applied in real clinical practice as a decision support system to doctors. This chapter discusses the use of AI in medicine, with an emphasis on the classification of patients with carotid artery disease, evaluation of patient conditions with familiar cardiomyopathy, and COVID-19 models (personalized and epidemiological). The chapter also discusses model integration into a cloud-based platform to deal with model testing without any special software needs. Although AI has great potential in the medical field, the sociological and ethical complexity of these applications necessitates additional analysis, evidence of their medical efficacy, economic worth, and the creation of multidisciplinary methods for their wider deployment in clinical practice. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

A Transfer Learning Method for Covid-19 and Pneumonia Diagnosis Based on Chest Radiograph Classification

Pneumonia has been a tough and dangerous human illness for a history-long time, notably since the COVID-19 pandemic outbreak. Many pathogens, including bacteria or viruses like COVID-19, can cause pneumonia, leading to inflammation in patients' alveoli. A corresponding symptom is the appearance of lung opacities, which are vague white clouds in the lungs' darkness in chest radiographs. Modern medicine has indicated that pneumonia-associated opacities are distinguishable and can be seen as fine-grained labels, which make it possible to use deep learning to classify chest radiographs as a supplementary aid for disease diagnosis and performing pre-screening. However, deep learning-based medical imaging solutions, including convolutional neural networks, often encounter a performance bottleneck when encountering a new disease due to the dataset's limited size or class imbalance. This study proposes a deep learning-based approach using transfer learning and weighted loss to overcome this problem. The contributions of it are three-fold. First, we propose an image classification model based on pre-trained Densely Connected Convolutional Networks using Weighted Cross Entropy. Second, we test the effect of masking non-lung regions on the classification performance of chest radiographs. Finally, we summarize a generic practical paradigm for medical image classification based on transfer learning. Using our method, we demonstrate that pre-training on the COVID-19 dataset effectively improves the model's performance on the non-COVID Pneumonia dataset. Overall, the proposed model achieves excellent performance with 95.75% testing accuracy on a multiclass classification for the COVID-19 dataset and 98.29% on a binary classification for the Pneumonia dataset. © 2023 IEEE.

Covid-19 crowd detection and alert system using image processing

In this paper, we aim to help in identifying the people that are violating social distancing norms set by the government (necessary during the COVID-19 pandemic in public places), by providing an efficient real-time deep learning-based framework to automate the process of monitoring the social distancing via object detection and tracking approaches. Our system is divided into two subsystems: one that deals with crowd detection and control, and the other that sends information to the police authorities. Our system technologies, including as IoT, image processing, web cams, BLE, OpenCV, and Cloud, are being considered for inclusion in the proposed framework. The image processing is divided into two sections, the first of which is the extraction of frames from real-time movies, and the second of which is the processing of the frame to determine the number of individuals in the crowd. Even in a crowd, dissemination may be restricted if people adhere to social distancing standards. As a result, the image processing model primarily targets the number of people who do not adhere to social distancing norms and stand too close together. © 2023 IEEE.

Evaluation of Masked Face Recognition of FaceNet Implemented with Machine Learning Algorithms

In image processing, Convolutional Neural Network (CNN) is an important tool for isolating image attributes for using with applications such as facial recognition. According to an outbreak of COVID-19, wearing masks has made face recognition less effective since face details are covered. FaceNet platform is a face feature extraction that is commonly applied to classification applications. Those applications embed FaceNet platform with supervised learning machine learning types to classify the considered objected on the detected image. Recently, Reinforcement Learning (RL) has been used in many applications on both prediction and classification tasks. However, the learning efficiency of RL has not been implemented and evaluated on masked face recognition yet. Therefore, the efficiency of the supervised learning techniques, ANN, KNN and SVM, are also implemented with the FaceNet platform for masked face recognition and they are compared with FaceNet platform implemented with the RL. The simulation results showed that ANN is the most efficient technique and followed by RL, KNN and SVM. The difference in efficiency (F1-scroce) between RL and the neural network was only 2%, but RL took four times more training time. © 2022 IEEE.

COVID-19 detection using lightweight CNN architecture on chest X-ray images

Coronavirus disease (Covid-19) detection has been a significant challenge for medical personal's all over the world. Reverse Transcription Polymerase Chain Reaction (RTPCR) is currently utilized to diagnose the Covid-19 disease. However, due to various subjective considerations and ambiguities, the RTPCR test is not a viable option in different circumstances. Radio-graphic images, such as chest X-rays are faster and less expensive than PCR tests while they can provide substantially good results in diagnosing Covid-19. In this research, a Convolutional Neural Network (CNN) model based on depthwise separable convolutions has been proposed to identify Covid-19 from chest X-ray images. Also, various state-of-the-art CNN model has been used and their performance metrics are compared. The analysis indicates that the proposed CNN model can correctly diagnose Covid-19 from the chest X-ray images with a substantially high validation and testing accuracy. © 2023 IEEE.

Chest Abnormality Detection from X-Rays Using Deep Learning

Coronavirus (COVID19) is a highly contagious virus which had already killed thousands of people and infected millions more throughout the world. One of the primary challenges that medical practitioners encounter in the realm of healthcare is correctly diagnosing patients conditions and infections. So far, the gold standard screening method RT-PCR test which has been designed to detect covid-19 which only has a positive rate ranging between 30 precent and 60 percent. As a result, a system that can accurately identify images and diagnose or anticipate diseases is needed. As a result, we set out to swiftly create a compact CNN architecture capable of recognizing COVID-19-infected individuals. Different CNN architectures are suggested in this paper to extract information from X-rays which further classified into Covid-19, pneumonia, or healthy. Here, we have used two datasets from publically available repositories that are Kaggle and Mendeley [1] [2]. To see how the size of datasets affects CNN performance, we train the suggested CNNs with both the original and enhanced datasets where datasets are splitted into ratios of 80:20 and 70:30 and the comparison is shown. Also suggested CNN model is compared with the five state-of-Art pre-Trained models (VGG-16, ResNet50, InceptionV3, EfficientNetB2, DenseNet121) with the same datasets and splitting ratios. we have also used Some visualization methods through which we can get an exact idea of how CNN functions and the explanation behind the network's decisions. This study suggests a model for classifying COVID-19 patients but makes no claims about medical diagnostic accuracy. © 2022 IEEE.

Image Processing and IoT-based Fish Diseases Identification and Fish Tank Monitoring System

Every person has their way of relaxing and having fun. The most well-liked approach to do it is to own a pet. When most individuals work from home and anxiety levels are high, people have certain restrictions on going outdoors and engaging in activities due to the existing COVID scenario. Consequently, we developed a product called AquaScanner. The problems that come with the aquarium environment can all be handled by our product. Our product primarily consists of an application that can regulate and monitor aquarium tanks by regulating feeding routines, fish disease detection, and water quality monitoring. The AquaScanner focuses on recognizing two significant illnesses, Fin Rot and Fungi bacteria, under the heading of disease identification. Additionally, the product will recommend treatments for the illness and provide two distinct methods for feeding the fish manually and automatically through the application. The AquaScanner can regulate feeding operations. Also, AquaScanner can independently monitor all key water parameters as part of the water quality measurement system. A user-friendly interface connects these three key elements. Owners of aquariums may manage and keep an eye on their beloved aquariums from anywhere in the world. © 2022 IEEE.

Towards Explainable AI on Chest X-Ray Diagnosis Using Image Segmentation and CAM Visualization

Computer vision in medical diagnosis has achieved a high level of success in diagnosing diseases with high accuracy. However, conventional classifiers that produce an image-to-label result provide insufficient information for medical professionals to judge and raise concerns over the trust and reliability of a model with results that cannot be explained. Class activation maps are a method of providing insight into a convolutional neural network's feature maps that lead to its classification but in the case of lung diseases, the region of concern is only the lungs. Therefore, the proposed model combines image segmentation models and classifiers to crop out only the lung region of a chest X-ray's class activation map to provide a visualization that improves the explainability and trust of an AI's diagnosis by focusing on a model's weights within the region of concern. The proposed U-Net model achieves 97.72% accuracy and a dice coefficient of 0.9691 on testing data from the COVID-QU-Ex Dataset which includes both diseased and healthy lungs. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

Dhanvantari: An intelligent diagnosis tool to classify malignant skin disease and Lung conditions using Deep Learning

The pandemic due to COVID-19 has created a huge gap in the medical field leading to a reduction in the efficacy of this field. To improve this situation, we propose a solution 'Dhanvantari'. A medical app that is powered by Artificial Intelligence performs a task where the diagnosis is done by computer vision observing CT scans, MRIs, and also some skin diseases. Dhanvantari focuses mainly on the combination of CT scans and skin disease classifications. In this paper, a novel approach has been proposed for developing a supervised model for the classification of skin disease and lung ailments (that is to identify a healthy lung with an infected lung due to pneumonia) through analog to digital image processing. This app helps the user in analyzing conditions and if any abnormalities are detected then alerts the user about it. This is a primary service care application developed to reduce the number of false cases hence only alerting the user if a complication is observed. The proposed approach utilizes a camera and computational device or mobile. Two datasets from Kaggle that had 9 classes of malignant skin disease and 2 lung conditions were used to train the model. Design, training, and the testing of the algorithm were performed with the help of colab. Generally, a standard test for malignant skin disease requires sample gathering and conduction of various tests. All these consume a lot of time. The other method is laser or radiation-induced procedures that might be harmful and lead to exposure of unwanted radiation to patients. The proposed 'Dhanvantari' requires the patient/user to use a camera to take a picture of the affected area (in case of skin condition) and it provides the primary diagnosis. This approach aids the doctors in quick decision-making during diagnosis and reduce the time per patient which in house helps them to prioritize patients. © 2022 IEEE.

Explainability of deep learning models in medical image classification

The ability to explain the reasons for one's decisions to others is an important aspect of being human intelligence. We will look at the explainability aspects of the deep learning models, which are most frequently used in medical image processing tasks. The Explainability of machine learning models in medicine is essential for understanding how the particular ML model works and how it solves the problems it was designed for. The work presented in this paper focuses on the classification of lung CT scans for the detection of COVID-19 patients. We used CNN and DenseNet models for the classification and explored the application of selected visual explainability techniques to provide insight into how the model works when processing the images. © 2022 IEEE.